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Abstract. In this note we re-propose the arguments presented in Vio & Andreani (2005) examining the superiority 
of the bi-parametric scale adaptive filter (BSAF) when dealing with source detection as claimed by Lopez-Caniego 
et al. (2005a) and confirmed in Lopez-Caniego et al. (2005b). We suggest here that the dispute can be easily 
solved if these authors provide the community with a detailed derivation of a basic equation. 
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1. Introduction 

In recent times, a controversy has arisen concerning 
the real performance of the bilinear scale adaptive filter 
(BSAF) introduced, in the context of one-dimensional sig- 
nals, by Lopez-Caniego et al. (2005a) (hereafter LHBSa) 
for the detection of sources in a Gaussian background. In 
particular, Vio & Andreani (2005) (hereafter VA) raised 
three points: 

— a) in LHBSa it is not clear how Eq. (8) 
p{v,n\v s 
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with v G (— co, +oc) and k € (0, +oo), was obtained , 
b) no formal explanation is provided concerning the 
real usefulness of the filtering operation before the ap- 
plication of the detection test; 



1 We remind that v and k are, respectively, the normalized 
value and curvature of the observed signal in correspondence 
to the true position of the source, whereas v a and His 3X6 the 
corresponding quantities of this. 



— c) the numerical experiments presented in the paper 
are not sufficient to support the claimed optimal char- 
acteristics of BSAF in real applications. 

It is our opinion that, even after the reply by Lopez- 
Caniego et al. (2005b) (hereafter LHBSb), these issues 
have not yet been satisfactorily addressed. In the following 
we present some arguments to support our believes. 

2. The reply by Lopez-Caniego et al. (2005) and 
our comments to it 

The objections to VA raised by LHBSb are clearly il- 
lustrated in their Conclusions. For sake of clearness, we 
report them for a direct comparison with our comments: 

a) " VA have questioned an allegedly unproved formula 
in our work, which is in fact rigorously derived from 
previous works in literature (Rice 1954; Bardeen et al. 
1986; Bond & Efstathiou (1987). Instead, VA pro- 
posed an incorrect formula? - We certainly believe 
that LHBSa have rigorously derived Eq. (1) from 
some already existing equations (in VA this point is 
never questioned). However, also in LHBSb, as well 
as in their original work, authors "forget" to provide 
the details. We stress again that the main problem is 
not the formula in se (which is certainly correct), but 
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rather the conditions of its validity that are not illus- 
trated. From their text it appears that this equation 
was derived with no restrictions concerning the rela- 
tive position of the source with respect to the position 
of the peaks of the Gaussian background. But, in their 
numerical simulations the detection test is applied only 
to the observed maxima, which - after the filtering - 
coincide with the true position of the sources. This 
implies that Eq. (1) gives the probability density of 
maxima only in presence of sources that satisfy some 
specific conditions. This is confirmed by what authors 
write in Sect. 3 of LHBSb: " We have derived the num- 
ber densities of maxima in two cases: when a source 
is located at the position of the maxima ( not "nearby 
the maxima") and when there is no source". Now, a 
question arises: under which conditions the peak of a 
source, superimposed to a background, is not moved to 
another position? Of course, one possibility is when, in 
correspondence to the position of the true maximum 
of the source, the first derivative of the background 
is equal to zero. This happens when a source is con- 
strained to be located in correspondence to a maxi- 
mum of the underlying noise process. Actually, also a 
minimum is possible, but in this case the additional 
condition \n n \ < n s has to be satisfied in order that n 
does not become negative (n n is the normalized cur- 
vature of the background at the true position of the 
source). In practical applications where the approach 
is expected to provide an effective improvement (i.e., 
sources with a smooth profile and white or quasi white- 
noise processes), this is a rare situation since p{y ni n n ) 
peaks at \n n \ 3> k s . This is because, contrary to the 
sources, the noise processes are dominated by the con- 
tribution of the high Fourier frequencies. Since the con- 
dition n n = has to be strictly satisfied, the case of a 
saddle point is even rarer if not an event with proba- 
bility zero. In LHBSa, but overall in LHBSb 2 , authors 
seem to suggest that sources located at the position of 
the observed maxima can be obtained also with more 
general composition of sources and background and no 
whatever explanation is provided here. 
We find peculiar that they did not consider as a nec- 
essary condition to settle this question that is crucial 
in understanding the potentialities and the limits of 
the approach. Indeed, our true criticism concerns 
the lack of a detailed presentation of the derivation 
of Eq. (1). 

Another point to stress is that, contrary to what 
claimed in LHBSb, in VA we do not propose any new 
formula to substitute Eq. (1). In fact, the density func- 
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2 In Sect. 2, LHBSb write "We would like to remark that 
Eq. (3)" (here Eq. (1)) "gives the number density of maxima 
coming from the combination of the background plus source. 
This does not mean, at all, that the maximum of the source has 
to coincide with the maximum of the noise process as stated by 
VA." 
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with v G (— oo,+oo) and k G (k s ,+oo), is explic- 
itly indicated to correspond to an unrealistic 
situation. The point we raised is that, forcing the 
observed sources to have the peak in correspondence 
of their true maximum, one favours the selection of the 
(filtered) sources that are located in correspondence 
to a maximum of the (filtered) noise, i.e., those whose 
likelihood p{y, n\v s ) is given by Eq.(2) (see below); 



b) "In their second comment, VA criticize the lack of 
generality of the approach proposed in Lopez-Caniego 
et al. (2005a). In particular, VA criticize the idea 
of filtering the data and applying the Neyman-Pearson 
detector to the local maxima. Instead, they suggest that 
the generalization of the derivation of the Neyman- 
Pearson detector, including not only amplitudes but 
also the second derivative of the field, should be done 
on purely theoretical derivation, and the likelihood they 
propose is not general either, since it does not include 
the first derivative of the field, that outside the max- 
ima is not zero. Our approach, however, is consistent 
and it leads to an improvement in the number of detec- 
tions." - In practical applications it is possible to work 
only with the observed^ maxima. In this context, the 
likelihood ratio Pf(v n ,5 n ,K n )/pii(is n ,K n ) indicated in 
VA is correct. In particular, pf(v n , S n ,K n ) corresponds 
to the joint probability density function (PDF) of the 
(normalized) height, the first and second derivatives 
of the background underlying the source in correspon- 
dence to the observed maximum. This PDF is given, 
for example, in Ochi (1990). 

Let us stress that the quantity n n is not necessarily 
equal to zero since there is no reason why the observed 
maxima have to coincide with the position of the true 
maximum of the source. In pr{.) it is S n = since, 
under the hypothesis that no source is present in the 
observed signal, the observed peaks correspond to the 
true peaks of the noise. We stress that the only reason 
why we have introduced this equation is to provide 
a natural extension of the classic Neymann-Pearson 
technique to be used as benchmark. We are not inter- 
ested to propose it as a possible alternative to BSAF. 
Concerning the effective usefulness in practical 
applications of the two steps (filtering + detec- 
tion) procedure suggested by LHBSa, we stress 
again that no rigorous theoretical arguments 
are presented. The authors discuss this aspect only 
in their Introduction but no mathematical formaliza- 
tion is given. 

c) "In their third comment, VA criticize a set of numer- 
ical experiments designed to test our theoretical argu- 
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merits precisely for being designed to test our theoreti- 
cal arguments. They suggest instead to make numerical 
experiments in order to test what the theory does not 
say. We have derived the number density of maxima 
in two cases: when a source is located at the position 
of the maxima (not "nearby the maxima") and where 
there is no source. The way to test the hypothesis ex- 
pressed by these formulas is exactly the one explained 
in Lopez-Caniego et al. (2005)." - These sentences 
make evident what is the main limit of the proposed 
procedure: the theoretical arguments on which it is 
based are developed under the condition that an ob- 
served (filtered) source is located at the position of 
a maximum of the observed (filtered) signal. Only 
under such condition it is correct what writ- 
ten in the Abstract of LHBSa: " The new filter in- 
cludes as particular cases the standard matched filter 
and the scale- adaptive filter. Then by construction, the 
bi-parametric scale adaptive filter outperforms these fil- 
ters" . However, this is not true in general situations. If 
in the conclusion of LHBSa this point had been clearly 
remarked, we should have no objections to their work. 
The numerical experiments are used by authors not 
only to test the correctness of their theory, but also to 
support the use of the proposed approach in practical 
applications but such experiments are not sufficient. 
The only thing they show is that BSAF overper- 
forms the matched filter when the position of a 
(filtered) source coincides with the position of 
its observed maximum. But the occurrence of such 
a case is rather infrequent and in fact in the experi- 
ments by LHBSa this particular case happens only in 
the 10% of the simulated signals. So a natural ques- 
tion arises: what happens in more general situations? 
No answer to that is given. It is not enough, as re- 
ported in LHBSb, referring to the results by Barreiro 
et al. (2003). In that work the filters have no free 
parameters to be optimized. 

In VA we stressed one more point: the investigation 
of the performance of the detection test only on the 
sources that (after the filtering) show a peak placed 
at the position of their true maximum, is not safe. 
This is because one favours the selection of the (fil- 
tered) sources that are located in correspondence to 
a maximum of the (filtered) noise, i.e., those whose 
likelihood p{v, n\i> s ) is given by Eq.(2). It is not dif- 
ficult to realize this in the discrete case (the case of 
interest for experimental signals). For example, for a 
source with a Gaussian profile G[i] located at the pixel 
i c , the addition of a white noise w[i], with standard 
deviation a w , will not shift the position of the peak 
if w[i c ] > w[i c ± 1]. Working in the discrete domain 
(i.e., with a stairstep approximation of the continuous 
functions) permits the alternative condition 



In practical applications the detection tests are used 
in situations of low signal to noise ratio (SNR) where 
A is a small quantity with respect to a w . The con- 
sequence is that the condition (3) is violated most 
of the times and the peak moves. In order to verify 
this point, we have carried out a simple numerical ex- 
periment where a source with Gaussian profile with 
dispersion set to three pixels and amplitude equal to 
one, has been superimposed to a Gaussian white-noise 
background with standard deviation set to 0.35. The 
level of noise has been chosen in such a way that, with 
a probability of false alarm is set to 10 -3 , in 1000 repli- 
cations of the experiment the classic matched filter is 
able to detect all the sources. This is a case with good 
SNR and yet about 90% of the cases where the posi- 
tion of the observed peak coincides with the position 
of the true maximum (approximately 33% of the to- 
tal number of simulations) is due to sources located 
at a maximum of the background, 0.6% to sources lo- 
cated in correspondence to a minimum, and the rest 
to sources for which condition (3) does not holds. As 
expected, the first percentage increases whereas the 
other two decrease when the SNR is worsen. This re- 
sult supports the suspects raised in VA. 

3. Some additional comments to the questions 
raised by Lopez-Caniego et al. (2005b) to VA 

1. The reason why we intentionally included some basic 
elements about matched filter is only to unambiguously 
define the formalism as well as the theoretical frame- 
work in which developing our arguments. We firmly 
believe that this is a good practice, especially in the 
context of data analysis in Astronomy where standard 
formalism and notation have not yet been fixed; 

2. In VA, the likelihood ratio 



L(x, v, k) — 



p(x,u,K\H 1 ) 



(4) 



w[i c ± 1] - w[i c ] < A, 
with A = G[i c ] -G[i c ±l]. 



(3) 



p(x,v,k\H ) 

is correctly written. As indicated by LHBSb, the term v 
is effectively redundant. We have maintained it to put 
in evidence the fact that the entire data set x as well as 
the characteristic of the observed maximum are consid- 
ered. One could not like this choice, but it is allowed. 
The likelihood ratio (4) is not an alternative method 
to BSAF, but only an attempt to provide a theoret- 
ical justification of the LHBSa approach. When the 
observed signal is filtered this implies the use of the en- 
tire data set x. After that, the detection test is based 
on the v and k quantities. Since these two operations 
are optimized together, we guessed that the likelihood 
ratio (4) could constitute a theoretical explanation of 
the two-steps approach by LHBSa. We are still con- 
vinced that this could be a possible explanation. In 
any case, it is a minor point; 
3. The complexity of BSAF in not a problem in se, rather 
with respect to the lack of flexibility of the method. In 
fact, in practical applications it is not advisable to use 
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a technique requiring a substantial modification of the 
basic equations even when only a condition is relaxed; 
4. As last comment we would caution these authors to 
claim that the arguments and/or some equations in 
VA are wrong. Indeed all of them are correct under 
the conditions that are explicitly given. 

4. Conclusions 

In this work we have further discussed the arguments 
presented in Vio & Andreani (2005) concerning the 
bi-parametric scale adaptive filter proposed by Lopez- 
Caniego et al. (2005a). In particular, we still question the 
claimed general optimal characteristics of this approach. 
Our claims are supported by the modality with which the 
numerical experiments have been carried out by the au- 
thors. 

A word of caution, the lack of rigorous theoretical foun- 
dation and clear assumptions made to test a theory may 
lead to wrong conclusions, especially in a field such as cos- 
mology where all sky data are not very sensitive and the 
signal-to-noise ratio per pixel is at best equal to one. Here 
we only urge the authors to prove the foundation of their 
work. The simplest way would be a detailed presentation 
of the basic equation that is missing in the original work. 
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